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Abstract 

The polarized electromagnetic wave in cylindrical fibers is 
described by a system of four component vector nonlinear 
Schrodinger equations. We have investigated analytically 
and numerically the modulational instability of this system. 
Several types of modulational instability are shown to exist 
depending on the sign of the dispersion coefficients. The 
results indicate that the group- velocity mismatch and the 
four wave mixing terms influence considerably the shape, 
position and especially the number of the spectral regions of 
the gain spectra of the modulation instability. Numerical 
simulations of the four component vector nonlinear 
Schrodinger equation show that the phenomenon of 
modulational instability gives rise to periodic pulse arrays of 
waves train. The presence of the four wave mixing terms 
influences considerably the evolution of the periodic pulse. 
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Introduction 

Vector solitons in multiple waveguides have drawn 
tremendous attention recently. While solitons can 
propagate over a long distance from a balance of 
dispersion and nonlinearity, coupling in two or more 
waveguides [1] permits additional flexibility which 
generates a rich variety of phenomena. The study of 
the dynamics of nonlinear waves is central to 
understand the behaviour of a wide range of physical 
systems, taking reference to [2], for example. In recent 
years, an important theme of much of this work has 


been the study of modulational instabilities (MI) of 
plane waves. MI occurs as a result of the interaction 
between the linear dispersive effect and the nonlinear 
effect, which is characterized by instability 
experienced by a continuous wave (CW) when it 
propagates inside a dispersive nonlinear system 
together with a weak noise. The perturbed wave 
experiences experimental growth and this leads to the 
breakup of the temporal profile of a wave into a train 
of ultrashort pulses [3, 4]. Since this disintegration 
typically occurs in the same parameter region where 
bright solitons are observed, MI is considered to some 
extent, a precursor to soliton formation in nonlinear 
systems [3]. The MI gain has been extensively studied 
for the scalar nonlinear Schrodinger type equations 
(NLSEs) [4]. The experimental evidence was then 
given that MI can be observed in a non-birefringent 
fiber with anomalous group velocity dispersion (GVD) 
[5]. This result has been confirmed subsequently by 
other observations of MI in the anomalous dispersion 
regime [6]-[7]. Vector MI can occur in isotropic fibers 
such that the gain spectrum depends on the 
polarization state of the input CW beam. It has been 
known, however, since the early studies by Bespalov 
and Talanov [8], and Berkhoer and Zakharov [9], that 
an incoherent (i.e., purely intensity dependent) 
couplingbetween two NLSE leads to extension of the 
instability domain in the normal dispersion regime. 
Unfortunately, it is very difficult to manufacture 
birefringence- free fibers. As an alternative, MI was 
observed in a bimodal fiber in which the input beam 
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excited two fiber modes with nearly equal power 
levels, and the two modes had the same group 
velocity [10]. However in a multi-mode fiber the 
velocity difference (walk-off) has to be taken into 
account, because different modes have substantially 
different group velocities. Previous studies have 
shown that the effect of walk-off among optical pulses 
can considerably modify the gain spectra of cross- 
phase modulation (XPM) induced MI [11]. So far, a 
different situation that is of considerable interest in 
nonlinear optics is the coherent coupling between two 
polarizations in a weakly anisotropic media. Coherent 
coupling can arise in the polarization of light beams, 
as the relative phase factors of the interacting electric 
fields there play a crucial role in the form of four-wave 
mixing (FWM) process. FWM in optical fibers can be 
both harmful and beneficial depending on the type of 
application. It can induce crosstalk in wavelength 
division multiplexing communication systems and 
limit the performance of such systems. The FWM- 
induced crosstalk can be minimized in practice 
through dispersion management, a technique in which 
the dispersion of each fiber section is made large 
enough that the FWM process is not phase matched 
through-out the link length [12]. At the same time, 
FWM is useful for variety of applications [13]. FWM 
can be useful for applications such as optical sampling, 
channel demultiplexing, pulse generation, and high- 
speed optical switching [14]. It can also be used for 
reducing quantum noise through squeezing, and for 
generating photon pairs that are quantum-correlated. 
The resulting model is a system of coherently coupled 
NLSE (CNLSE). In the light of the above mentioned 
facts, it is worthwhile to study the phenomenon of MI 
in a fiber system with the FWM nonlinearity. Recently, 
MI in a system of coherently CNLSE has been 
investigated and it was found that the nonlinearity 
arising from phase coherence enlarges the range of 
XPM- induced MI [15]. Modulation instabilities arising 
from systems of four CNLSE have also been studied 
earlier in the literature [16]. It was found here that MI 
can appear even in the regime where the XPM 
coefficient is less than that of the self-phase 
modulation (SPM). The group- velocity mismatch 
(GVM) and the mixed interaction between different 
modes (FWM) have been neglected. Therefore, 
generally speaking, both of the walk- off effects and 
FWM terms should be taken into consideration in the 
study of XPM induced-MI in the four CNLSE. Our 
motivation in the present work is to study the MI of 
the four CNLSE, derived by Leble and Reichel [17]. 


The remainder of the article is arranged as follows. In 
section 2, a system of four CNLSE is presented. In 
section 3, we study the linear stability analysis of this 
model equation. The results of MI gain are 
investigated in section 4. Typical outcomes of the 
nonlinear development of the MI are reported in 
section 5 and section 6 concludes the paper. 


The model 


Wave propagation for pulses of polarized 
electromagnetic waves in cylindrical fibers is governed 
by a CNLSE [17] 
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Here, X ^ and Xq are the pulses envelope in each 
polarization mode (two modes and each mode has two 
polarizations).^ and (j=0, 1) denote the GVM of 
pulses and the GVD, respectively. O x and Q 1 are SPM 
coefficients. 0 2 , 0 3 , 0 4 , Q 2 , Q 3 , and Q 4 are the XPM 
coefficients. The nonlinear coefficient s0 5 , 0 6 ,Q S and Q 6 
describe mixed interaction between different modes 
and different polarization (FWM). In the limit of high 
birefringence, the FWM mixing terms in Eq. (1) can be 
neglected as they can be averaged to zero. In contrast, 
these coherent phase nonlinearities will be retained in 
the present work. Although solitons have been studied 
intensively [18-21], the focus here will be on the MI of 
plane waves of Eq. (1). Many existing works have 
assumed the low birefringence limit. The first objective 
here is to demonstrate that restoring this physics 
changes considerably the MI sidebands. Secondly, 
inclusion of phase dependent nonlinearity will be 
shown to extend the XPM- induced MI of the CNLSE. 


The linear stability analysis 

In order to investigate the evolution of weak 
perturbations along the propagation distance, we 
carry out a linear- stability analysis. Firstly, we look for 
CW solution of the system described by Eq. (1) given 
by: 

X^VPj^expiQ-WjZ), j=0,l (2) 

where is the power of the plane wave and the real 
phase0 7 are given by: 
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In order to examine the linear-stability of the CW 
states, we introduce the perturbed fields of the form 


Xji=( / Pji+afi )exp (-i0j z), j=0, 1 


( 4 ) 


Where a . By substituting Eq. (1) and 

retaining linear terms of , we obtain four linearized 
equations: 
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imaginary part, which results in an exponential 
growth of the amplitude with the perturbation. By 
requiring the determinant of the associated matrix in 
Eq. (7) to vanish, we can find the solvability condition 
for these equations, which amounts to a polynomial of 
degree eight. The MI phenomenon is measured by a 
power gain given by G = 2|/7n(A r )l where K is the 
eigenvalue of MI that possesses the largest imaginary 
part [22]. 

The Modulational Instability Gain 

The MI gain will be calculated and discussed for 
different dispersion regions in the following. To 
simplify the discussion, we set the incident optical 
powers of the four optical waves as = P. We set 
also the GVM as = —a^= 6. We have also chosen 
the following physical parameters [23]: = 

0.06ps 2 /m (j=0, 1), O x = Q t = 1, 0 2 = Q 2 = 2, 0 3 = 0 4 = 
Q 3= Q 4 = 2/3, O s = 0 6 = Q s = Q 6 = 1/3, P = 1.5 W. The 
parameter 6 = 2—5 ps/m for a wavelength difference 5 
- lOnm. Several qualitatively different situations 
emerge depending on the signs of dispersion 
coefficients. 


Case 1 : ^ 0 + i < 0 ,/? 0 "i < 0 ,/?^ < O,/?^ < 0 


if = -4 iPn 1# - Ii + «n) + 

Ql Jp^t ( a ll + ofi*) + Q 3 JPuPoi ( a oi + a oi*) + 
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In this case, all the four beams propagate in the 
anomalous GVD of the fiber. This case is of particular 
importance since each beam can develop MI even in 
the absence of the XPM coupling. The gain spectra of 
MI for different parameters 6 have been shown in FIG. 
1. We have obtained in this case in FIG. 1 (al) only one 
sideband. 


where * denote complex conjugate. We assume 
general solutions of the form 

exp(iQt) +xVj : exp(-iQt), j=0, 1 (6) 

Inserting Eq. (5), one obtains a set of eight linear 
ordinary differential equations 

17=i[M][Y] (7) 

where [M] is an 8x 8 matrix with 

[Y]=[tt+ Uoi, VoT, uk.itf.Uu, vii*] T . The elements 
of [M] are given in appendix. The above 8x8 matrix is 
referred to as stability matrix which is used to study 
the stability of the system under consideration. MI 
occurs only when at least one of the eigenvalues of the 
stability 8x 8matrix possesses a nonzero and negative 



FIG. 1(A1) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES . THE FOUR BEAMS EXPERIENCES 
ANOMALOUS GVD. THE FIBER PARAMETERS ARE p± = 

— 0.06Ps 2 /M, /?* = - 0.06Ps 2 /M, 0 1 = Q t = 1, 0 2 = Q 2 = 2, 0 3 = 0 4 = 
Q 3 = Q 4 = 2/3, 0 3 =0 6 = Q s =Q 6 = 1/3,P = 1.5W 

As 5 increases, the number of the spectral peak 
increases also as seen in FIG. 1 (a2). 
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FIG. I(a2) THE MI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARiriES . THE FOUR BEAMS EXPERIENCES 
ANOMALOUS GVD. THE FIBER PARAMETERS ARE /?* = 
-0.06ps 2 /m, /?*!= - 0.06ps 2 /m, 0 1 = Q x = 1, 0 2 = Q 2 = Z 0 3 = 0 4 = 

Qs = Q 4 = 2/3,0 s =0 6 = Q s =Q 6 = 1/3, P = 1.5 W 

and on further increasing b, we observe in FIG. 1 (a3) 
that the additional sidebands are suppressed. 



FIG. I(a3) THE MI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES . THE FOUR BEAMS EXPERIENCES 
ANOMALOUS GVD. THE FIBER PARAMETERS ARE /?* = 

— 0.06ps 2 /m, /?* 1 = — 0.06ps 2 /m, 0 1 = Q x = 1, 0 2 = Q 2 = Z 0 3 = 0 4 = 
Q 3 = Q 4 = 2/3,0 s =0 6 = Q s =Q 6 = 1/3, P = 1.5 W 

For the large values of b, we observe in FIG. 1 (a4) only 
one sideband. 



FIG. I(a4) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES . THE FOUR BEAMS EXPERIENCES 
ANOMALOUS GVD. THE FIBER PARAMETERS ARE /?* = 

— 0.06ps 2 /m, /?* 1 = — 0.06ps 2 /m, 0 X = Q x = 1, 0 2 = Q 2 = 2, 0 3 = 0, x — 
Q 3 = Q 4 = 2/3,0 5 = 0 6 = Q 5 =Q 6 = 1/3, P = 1.5 W 


By comparison in FIG. 1 (b) where we have taken into 
account the FWM nonlinear coefficients, the gain 
spectrum takes on new characteristics and the number 
of the spectral peak are quite different from those of 
FIG. 1 (a). 



FIG. l(bl) THE MI GAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEAR1TIES ARE TAKEN INTO ACCOUNT. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, /?* = - 0.06ps 2 /m, O t = Q t = 1 , 
0 2 = Q 2 =2,0 3 = 0 4 = Q 3 = Q 4 = 2/3,0^ = 0 6 =Q s =Q 6 = 1/3, P = 

1.5 W 



FIG. I(b2) THE MIGAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEAR1TIES ARE TAKEN INTO ACCOUNT. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, p±= - 0.06ps 2 /m, 0 X = Q x = 1, 
0 2 = Q 2 =Z0 3 = 0 4 =Q 3 = Q 4 = 2/3, Os = 0 6 =Qs=Q 6 = 1/3, P = 

1.5 W 



FIG. I(b3) THE MIGAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEAR1TIES ARE TAKEN INTO ACCOUNT. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, p±= - 0.06 P 5 2 /m, 0 X = Q x = 1, 
0 2 = Q 2 =Z0 3 = 0 4 =Q 3 = Q 4 = 2/3, Os = 0 6 =Qs=Q 6 = 1/3, P = 

1.5 W 
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FIG. I(b4) THE MI GAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEA RITIFS ARE TAKEN INTO ACCOUNT. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, /?* = - 0.06ps 2 /m, 0 1 = Q ± = 1, 
0 2 = Q 2 = 2,0 3 = 0, = Q 3 = Q 4 = 213,0s = 0 6 =Q s =Q 6 = 1/3, P = 
1.5 W 

Case 2: /?<£ < 0,/? 0 "i < 0,/?^ > 0,/?^ > 0 

In this case, the first mode experiences anomalous 
GVD, while the second mode propagates in the 
normal GVD region. When 5 = 2 , we observe in FIG. 2 
(al) only one spectral peak. 



FIG. 2(al) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES . THE FIRSTMODE EXPERIENCES 
ANOMALOUS GVD, WHILE THE SECOND MODE PROPAGATES 
IN THE NORMAL DEPERS ION REGIME. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, /?* = 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1 



FIG. 2(a2) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES. THE FIRSTMODE EXPERIENCES 
ANOMALOUS GVD, WHILE THE SECOND MODE PROPAGATES 
IN THE NORMAL DEPERS ION REGIME. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, /?± = 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1 


www . s eip ub . orgf ap 

but with the increase of the parameter 5 , we observe in 
FIG. 2 (a2) that the position of the spectral peak varies, 
and in FIG. 2 (a3) that the number of the spectral 
region increases. 



FIG. 2(a3) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES. THE FIRSTMODE EXPERIENCES 
ANOMALOUS GVD, WHILE THE SECOND MODE PROPAGATES 
IN THE NORMAL DEPERS ION REGIME. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, /?* = 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1 

For 5 > 5, we have seen that the spectral peaks are 
totally suppressed. When we take into account the 
FWM nonlinear coefficients, we observe in FIG. 2 (bl)- 
FIG. 2(b3), that these coefficients alter the number and 
the position of the spectral peaks. 



FIG. 2(bl) THE MIGAIN SPECTRA IN THE PRESENCE OF THE FWM 
NONLINEARITIES. THE FIRSTMODE EXPERIENCES 
ANOMALOUS GVD, WHILE THE SECOND MODE PROPAGATES 
IN THE NORMAL DEPERS ION REGIME. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, /?* = 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1 

Case 3: > O,/?^ > 0,/?^ < 0,/Jfi < 0 

In this case, the first mode experiences normal GVD, 
while the second mode propagates in the anomalous 
GVD region. The gain spectra of MI for different 
parameters 5 have been shown in FIG. (3). When 5 = 2 , 
the gain spectrum in FIG. 3 (al) contains four spectral 
regions. 
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FIG. 2(b2) THE MIGAIN SPECTRA IN THE PRESENCE OFTHE FWM 
NONLINEARITIES. THE FIRSTMODE EXPERIENCES 
ANOMALOUS GVD, WHILE THE SECOND MODE PROPAGATES 
IN THE NORMAL DEPERS ION REGIME. THE FIBER 
PARAMETERS ARE /?*« -0.06ps 2 /m, /?* = 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1 
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FIG. 2(b3) THE MIGAIN SPECTRA IN THE PRESENCE OFTHE FWM 
NONLINEARITIES. THE FIRSTMODE EXPERIENCES 
ANOMALOUS GVD, WHILE THE SECOND MODE PROPAGATES 
IN THE NORMAL DEPERS ION REGIME. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, p± = 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1. 



FIG. 3(al) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES. THE FIRST MODE PROPAGATES IN THE 
NORMAL DEPERS ION REGIME, WHILE THE SECOND MODE 
EXPERIENCES ANOMALOUS GVD. THE FIBER PARAMETERS 
ARE /?* = 0.06ps 2 /m, p± = - 0.06ps 2 /m. OTHER PARAMETERS 
ARE DENTICAL TO THOSE USED FOR FIG. 1 
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With the increase of the parameter <5, it can be realized 
that the number of the spectral peak decreases and we 
observe only two sidebands. For the large values of <5, 
the bandwidth of the second sideband increases, while 
the peak gain of the first sideband decreases (FIG. 
3(a2)- (a4)). 



FIG. 3(a2) THEMI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES. THE FIRSTMODE PROPAGATES IN THE 
NORMAL DISPERSION REGIME, WHILE THE SECOND MODE 
EXPERIENCES ANOMALOUS GVD. THE FIBER PARAMETERS 
ARE /?* = 0.06ps 2 /m, p±= - 0.06ps 2 /m. OTHER PARAMETERS 
ARE DENTICAL TO THOSE USED FOR FIG. 1. 



FIG. 3(a3) THE MI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES. THE FIRST MODE PROPAGATES IN THE 
NORMAL DEPERS ION REGIME, WHILE THE SECOND MODE 
EXPERIENCES ANOMALOUS GVD. THE FIBER PARAMETERS 
ARE p±= 0.06ps 2 /m, p± = - 0.06ps 2 /m. OTHER PARAMETERS 
ARE DENTICAL TO THOSE USED FOR FIG. 1. 



FIG. 3(a4) THE MI GAIN SPECTRA WITHOUT THE FWM 
NONLINEARITIES. THE FIRST MODE PROPAGATES IN THE 
NORMAL DEPERS ION REGIME, WHILE THE SECOND MODE 
EXPERIENCES ANOMALOUS GVD. THE FIBER PARAMETERS 
ARE /?*= 0.06ps 2 /m, /?* = - 0.06ps 2 /m. OTHER PARAMETERS 
ARE DENTICAL TO THOSE USED FOR FIG. 1. 
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Furthermore, Fig. 3 (bl)-Fig. 3 (b4) show also that with 
the presence of the FWM coefficients, the spectral 
peaks are different with those obtained in Fig. 3 (a). 



FIG. 3(bl) THE MI GAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEARITIES ARE TAKEN INTO ACCOUNT. THE FIRST 
MODE PROPAGATES IN THE NORMAL DISPERSION REGIME, 
WHILE THE SECOND MODE EXPERIENCES ANOMALOUS GVD 
THE FIBER PARAMETERS ARE /?* = 0.06ps 2 /m, p±= - 0.06ps 2 /m. 
OTHER PARAMETERS ARE IDENTICAL TO THOSE USED FOR 
FIG. 1 



FIG. 3(b2) THE MIGAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEARITIES ARE TAKEN INTO ACCOUNT. THE FIRST 
MODE PROPAGATES IN THE NORMAL DISPERSION REGIME, 
WHILE THE SECOND MODE EXPERIENCES ANOMALOUS GVD 
THE FIBER PARAMETERS ARE /?* = 0.06ps 2 /m, p±= - 0.06ps 2 /m. 
OTHER PARAMETERS ARE IDENTICAL TO THOSE USED FOR 
FIG. 1 
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FIG. 3(b3) THE MI GAIN SPECTRA IN THE CASE WHERE THE FWM 
NONLINEARITIES ARE TAKEN INTO ACCOUNT. THE FIRST 
MODE PROPAGATES IN THE NORMAL DISPERSION REGIME, 
WHILE THE SECOND MODE EXPERIENCES ANOMALOUS GVD 
THE FIBER PARAMETERS ARE /?± = 0.06ps 2 /m, p±= - 0.06ps 2 /m. 
OTHER PARAMETERS ARE IDENTICAL TO THOSE USED FOR 
FIG. 1 
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FIG. 3(b4) THE MIGAIN SPECTRA IN THE CASE WHERE THE 
FWM NONLINEARITIES ARE TAKEN INTO ACCOUNT. THE 
FIRST MODE PROPAGATES IN THE NORMAL DISPERSION 
REGIME, WHILE THE SECOND MODE EXPERIENCES 
ANOMALOUS GVD. THE FIBER PARAMETERS ARE /?± = 
0.06ps 2 /m, p±= - 0.06ps 2 /m. OTHER PARAMETERS ARE 
IDENTICAL TO THOSE USED FOR FIG. 1 

Numerical Simulations in Different GVD 
Domains 

Direct numerical simulations were run in order to 
understand the dynamics of CW states under the MI 
in the nonlinear regime. We have solved Eq. (1) using 
a split-step Fourier method applying the fast Fourier 
transforms [24]. The numerical simulations have been 
carried out using various step sizes down to 0.0001 
throughout the z direction, with up to 1024 points 
along the t direction. The CW state was initially 
perturbed as: 

x ai =a/T( l±0.005)cos(nt) 

x u = 1 /T( 1 ±0-005)cos(flt) (8) 

where P 0 = 1.5 is the power of the CW and O = 0.2 is 
the angular frequency of the weak sinusoidal 
modulation imposed on the CW. Examples of different 
numerical results are shown below. 

Casel: /?oi < 0,/? 01 < 0,/?{i > 0,/? n > 0 

FIG. (4) shows the evolution of the CW solution given 
by Eq. (8). In FIG. 4 (a), we have neglected the FWM 
nonlinearities and we can see here a formation of a 
periodic wave train. The period of these pulses is the 
same as that of the initial perturbation and equal to 
2ti/Q. 
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FIG. 4 (a) DIFFERENT PROPAGATION RESULTS WITHOUT THE 
FWM NONLINEARITIES . THE FIBER PARAMETERS ARE /?* = 

— 0.06ps 2 /m, /?* = 0.06ps 2 /m. OTHER PARAMETERS ARE 
IDENTICAL TO THOSE USED FOR FIG. 1 

A similar result had been obtained in a system of two 
parallel-coupled fibers modeled by two linearly 
coupled complex Ginzburg-Landau equations [25] and 
in a system of higher -order complex Ginzburg-Landau 
equation, with the fourth- order dispersion and cubic- 
quintic nonlinear terms [26]. But after a certain 
distance of propagation, the wave trains become 
unstable. By comparison, in FIG. 4(b) where the FWM 
coefficients are taken into account, we observe that the 
pulse can still propagate stably without any distortion. 
But at the end of the propagation, the number of the 
pulses is increased by a factor two. 



FIG. 4(b) DIFFERENT PROPAGATION RESULTS WFTH THE FWM 
NONLINEARITIES . TFtE FIBER PARAMETERS ARE /?* = 
-0.06p> 2 /m,(]±= 0.06ps 2 /m. OTHER PARAMETERS ARE 
IDENTICAL TO THOSE USED FOR FIG. 1. 

Case 2: p^ > 0,/fo > 0 ,p^ < 0 ,/?fi < 0 

In FIG. 5 (a) where we have neglected the FWM 
nonlinearities, we show an example of the first 
situation where a periodic wave trains is formed. But 
as in the previous case the pulses are distorted at the 
end of the propagation. 
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FIG. 5 (a) DIFFERENT PROPAGATION RESULTS WITHOUT THE 
FWM NONLINEARITIES. THE FIBER PARAMETERS ARE /?* = 
0.06ps 2 /m, /?* = - 0.06ps 2 /m. OTHER PARAMETERS ARE 
IDENTICAL TO THOSE USED FOR FIG. 1 

Another example of the evolution is shown in FIG. 5(b) 
where the FWM nonlinearities are taken into account. 
We can see the amplitude of the wave trains increases 
progressively with the propagation distance. However, 
contrary to the previous case, the number of the pulses 
is constant. 
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FIG. 5(b) DIFFERENT PROPAGATION RESULTS WITH THE FWM 
NONLINEARITIES. THE FIBER PARAMETERS ARE/?* = 0 . 06 ps 2 /m, 
/?*= - 0.06ps 2 /m. OTHER PARAMETERS ARE IDENTICAL TO 
THOSE LB ED FOR FIG. 1 
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FIG. 6(a) DIFFERENT PROPAGATION RESULTS WITHOUT THE 
FWM NONLINEARITIES. THE FIBER PARAMETERS ARE/?^ = 
— 0.06ps 2 /m, /?* = - 0.06ps 2 /m. OTHER PARAMETERS ARE 
IDENTICAL TO THOSE USED FOR FIG. 1 
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Case 3: /?qi < 0,/? 0 “i < 0,/?^ < 0,/?fi < 0 

The obtained results are completely different from 
those obtained in previous case. For example, when 
we neglect the FWM nonlinearities, we observe in FIG. 
6 (a) that at the beginning of the propagation, the 
waves train are stable. But, at the end of the 
propagation, these wave trains are distorted. 

By taking into account the effect of the FWM 
nonlinearities in FIG. 6 (b), we observe that the waves 
train still propagate stably without any distortion. 



FIG. 6(a) DIFFERENT PROPAGATION RESULTS IN THE 
PRESENCE OF THE FWM NONLINE ARTTIES. THE FIBER 
PARAMETERS ARE /?* = -0.06ps 2 /m, p±= - 0.06ps 2 /m. OTHER 
PARAMETERS ARE IDENTICAL TO THOSE USED FOR FIG. 1 

Conclusions 

The full treatment of MI of continuous waves for a 
system of coherently CNLSE relevant to the 
polarization of light beams has been studied. In 
contrast to the previous works, the finite birefringence 
effect and phase dependent nonlinearity (i.e. the FWM 
terms) have been considered. The results indicate that 
both the GVM and the FWM terms will alter the gain 
spectra of MI considerably in terms of shape, position 
and especially the number of the spectral regions, but 
in different ways. Moreover, the nonlinear evolution 
of MI for the presence of phase dependent 
nonlinearity has been studied numerically using split- 
step Fourier method. The most notably change occurs 
when both beams propagate in the anomalous 
dispersion regime. We have observed here that when 
the FWM nonlinearities are omitted, the MI leads to a 
pattern in the form of periodic pulses array which are 
distorted at the end of the propagation. FFowever, 
when the FWM nonlinearities are added, we have 
obtained that periodic pulses might propagate without 
any distortion. In order cases in which two beams 
propagate in the anomalous dispersion regime and the 
two others in the normal dispersion regime, the 
situation is quite different. The undistorted pulses are 
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observed only in the case where the FWM 
nonlinearities are omitted. 
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APPENDIX 

Matrix elements of Eq. (7) are given by 

mn = -^22 = m.44 = m 33 = -^H 2 + - 

0 1 P 0 y ,m 12 = m 34 = m 23 = — m 2i = — m 43 = — 0 1 P^, 

™i 3 = m 3 1 = m 32 = m 14 = -m 41 = -m 23 = - m 24 = 

-m 42 = - O 2 Jp 0 ^P 0 f, 

™ 15 = m l6 = m 37 = ™ 38 = ~ m 2S = ~ m 26 = ~™47 = 

-m 4B = ~(0 3 J^ + 0 6 Jffif£h 

m 17 = m 18 = m 35 = m 36 = -m 27 = - m 28 = -m 45 = 
-m 46 ee ~(0 4 J^ + 

™5i = ~m 61 = ~m 62 = m 73 = m 52 = m 74 = -m 83 = 
-m 84 = h 

^53 = ^54 = -m 63 = - m 64 = m 71 = m 72 = -m 81 = 
-m 82 = ~(Q 4 J itf/* + h 

m 55 = ~ m 66 = ™-77 = m 88 = -fill + 4 n “ Ql P U ' 
m 56 = ~ m 65 = m 78 = ~ m 87 = ~Q l P {l' 

m S7 ~ m S8 ~ ~ m 67 ~ ~ m 68 = m 7S = m 76 = ~ 771 8 5 = 

m 86 = ~ 02 ^ 11 ^ 11 / 
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